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Field 

5 The embodiments of the present invention relate generally to digital content 

and more specifically to annotating meta-data describing digital content. 

Background 

A variety of ranking systems exist today. Some of the ranking systems are 
1 0 voluntary systems and others are involuntary systems. 

One example of a voluntary ranking system is a restaurant guide such as the 
Zagat's restaurant guides or other similar restaurant guides. The Zagat's restaurant 
guide provides a ranking based on active feedback received from customers 
worldwide. In other words, the customer who visited the restaurant must voluntarily 
1 5 complete and submit a predefined restaurant review form to the organization 
compiling the restaurant guide. Thus, this type of ranking system requires active 
participation from the restaurant customers. However, a significant drawback to a 
voluntary ranking system is the fact that it requires people to actively do something. 
Because not all people will respond, the ranking is based on less than all of the 
20 user's opinions. The ranking may also be biased because people with strong 

positive or negative opinions may be more likely to respond than other people who 
do not have a reason to respond. 

In contrast, other ranking systems are implemented without requiring explicit 
user action. For example, Google is currently a popular Internet search engine that 
25 relies on an involuntary system for ranking the usefulness of web pages. Web pages 
are ranked by the amount of cross-references (also referred to as links) measured in 
a web crawl. The amount of cross-references maybe a good gauge of the 
usefulness of a particular web page to a user. Anonymous web users act as 
involuntary reviewer/critics when they considered a web page worthy of a link. 
30 Thus, the ranking system used by the Google search engine is derived from the 
structure of the web without active user involvement in the process. 
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Another example of an involuntary ranking system is the Citation Index. 
The Citation Index is a tool to grade the quality/novelty of scientific papers after 
publication. The Citation Index compiles the number and list of cross-references 
that a given paper receives from other researchers in their publications. The Citation 
Index does not require authors of papers to submit a list of cross-references to the 
organization compiling the index. Rather, like the Google Internet search engine, 
the Citation Index implements involuntary ethnographic ranking without requiring 

explicit user action. 

However, no involuntary ethnographic ranking system is currently available 
for grading media content. One reason for this is the lack of automatic methods for 
meta-data generation. The lack of automatic methods for meta-data generation is a 
significant barrier to efficient browsing and sharing of digital content. 

For example, people watch good and bad movies, but there is no mechanism 
to efficiently provide feedback, other than Nielsen ratings and biased opinions of 
movie critics. Good movies make people cry and laugh, bad movies make people 
fast forward to skip the boring sections or even abandon viewership. Some content 
has a few precious segments embedded in vast amounts of long boring predictable 
sequences. Manual meta-data annotation to indicate good movies and bad movies is 

not an efficient solution. 

In another example, people collect images. Photo albums contain gems and 
also contain massively boring content. People viewing the collections of images are 
forced to withstand boredom to get to the gems over and over. Previous viewers do 
not leave a trace to help others find the gems. Traditional methods (i.e., manual 
annotations) are not efficient because there is no reason for the viewer to provide an 
evaluation of a piece of content just seen. 

Recently, digital packaging of data and respective meta-data have emerged 
as an attractive infrastructure solution to content centric distribution and 
management of digital assets, including 3D models, images, video, and audio - vis- 
a-vis MPEG-21 . In these systems, meta-data has been used to hold packaging 
manifests for packaged media, to detail and extend semantic content description as 
well as to provide infrastructure for content addressability to the final user. 
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Traditionally, meta-data is attached to the content upon creation, and most of the 
meta-data pertains to the description of tangible properties of the multimedia 
package. Any user specific meta-data is currently input manually which creates a 

barrier to wide-spread adoption. 
5 For these and other reasons, there is a need for embodiments of the present 

invention. 

Brief Description of the Drawings 

Figure 1 is ablock diagram of a general computing environment according to 

1 0 one embodiment of the invention. 

Figure 2 is a functional block diagram of one embodiment of a receiver, such 

as the receiver shown in Figure 1 . 

Figure 3 is ablock diagram of one embodiment of a data structure for digital 

content and associated meta-data. 
15 Figure 4 is a more detailed block diagram of an example embodiment of a 

processing module such as the processing module shown in Figure 2. 

Figure 5 is a flow diagram of a method according to an example embodiment 

of the invention. 

Figure 6 is a flow diagram of a method according to another example 

20 embodiment of the invention. 

Figure 7 is a block diagram of an electronic system for annotating meta-data 
with user responses in accordance with one embodiment of the invention. 

Description of the Embodiments 

25 In the following detailed description of the embodiments, reference is made 

, 0 the accompanying drawings which form a part hereof, and in which is shown by 
way of iltastration specific embodiments in which the invention may be practtced. 
These embodiments are described in snfficien. detail to enable those skilled m the 
art to practice the invention, and it is to be understood that other embodiments may 

30 be ntilized and that structural, logical and electrical changes may be made wtthont 

departing from the spirit and scope of the present invention, The following detatled 
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description is, therefore, not to be taken in a limiting sense, and the scope of the 
present inventions is defined only by the appended claims. 

Embodiments of systems and methods for annotating meta-data with user 
responses to digital content are described. Digital content refers to digital 
representations of created works including audio (such as music and spoken words), 
artwork (such as photographs and graphics), video, text, multimedia and the like; as 
well as digital representations of new forms of content that become available in the 
future. 

The detailed description is divided into four sections. In the first section, a 
system overview is provided for embodiments of the invention. In the second 
section, methods of using example embodiments of the invention are described. In 
the third section, various example scenarios are described. In the fourth section, a 
general hardware and operating environment in conjunction with which 
embodiments of the invention can be practiced is described. 

System Overview. A system overview of example embodiments of the 
invention is described by reference to Figures 1 , 2, 3 and 4. 

Figure 1 is a block diagram of a general computing environment according to 
one embodiment of the invention. The general computing environment 100 shown 
in figure 1 comprises originators 102 and receivers 104 of digital content. The terms 
"receiver" and "originator" are arbitrary in that one may also perform the operations 
of the other. Originators 102 and receivers 104 are in communication with each 
other over a network 106 such as an intranet, the Internet, or other network. An 
originator 102 provides digital content to one or more receivers 104 either at the 
request of the receiver 104 or at the initiative of the originator 102. In one 
embodiment, the originators 102 and the receivers 104 are peers in a peer-to-peer 
network. In an alternate embodiment, the originator 1 02 is a server and the receivers 
104 are clients in a client-server network. 

Figure 2 is a functional block diagram of one embodiment of a receiver 104, 
such as the receiver 104 shown in Figure 1. Figure 2 is a more detailed 
representation of an example embodiment of the receiver 104 shown in Figure 1 . In 
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an example embodiment, the receiver 104 comprises one or more inputs 108, one or 
more processing modules 1 10 and one or more outputs 1 12. 

In one embodiment, the inputs 108 represent data about a user's response to 
digital content. In another embodiment, the inputs 108 also represent data to 
identify a user. A user is any entity that interacts with or makes use of digital 
content. In an example embodiment, a user is an individual and the data about the 
user's response to digital content represents the individual's opinion. In alternate 
embodiments, examples of users include consumers, communities, organizations, 
corporations, consortia, governments and other bodies. In this alternate 
embodiment, the data about the user's response represents an opinion of a group. 
For example, the users may be an audience at a movie theater. In one embodiment, 
the data about the user's response represents individual opinions of members of the 
audience at the movie theater. In an alternate embodiment, the data about the user's 
response represents a single group opinion for the entire audience at the movie 
theater. 

Embodiments of the invention are not limited to any particular type of data 
about a user's response to digital content. Some types of data about a user's 
response include, but are not limited to, data from physiological processes, data 
from nonverbal communications, data from verbal communications, and data from 
the user's browsing or viewing patterns. Some examples of data from physiological 
processes include breathing, heart rate, blood pressure, galvanic response, eye 
movement, muscle activity, and the like. Some examples of data from nonverbal 
communications include data representing facial gestures, gazing patterns, and the 
like. Some examples of data from verbal communications include speech patterns, 
specific vocabulary, and the like. Some examples of data from the user's browsing 
or viewing patterns include the length of time spent viewing the digital content and 
the number of times the digital content is viewed. 

Outputs 1 12 represent the result produced by the processing module 1 10 in 
response to the inputs 108. An example output 1 12 is user-specific meta-data 
associated with the digital content. The user-specific meta-data describes the user's 
response to the digital content. The meta-data is generated automatically from the 
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user's reactions. The meta-data generation is transparent to the user. Another 
example output 1 12 is data representing a ranking of the digital content based on the 
user's responses. In example embodiments in which it is desirable for the ranking to 
have statistical relevance, user reactions are collected from a statistically significant 
number of users. In still another embodiment, the output 1 12 provides an automatic 
ethnographic ranking system for digital content. 

Figure 3 is a block diagram of a data structure according to one embodiment 
of the invention. The data structure 1 14 comprises digital content 1 16 and 
associated meta-data 1 18. The meta-data 1 1 8 is data about the digital content 1 16. 
According to an example embodiment of the invention, the meta-data 118 comprises 
one or more annotations representing a user's response to the digital content 1 16. In 
another embodiment, the meta-data 118 also identifies an originator (shown in 
Figure 1 as element 102) of the digital content 116. 

An annotation is a comment or extra information associated with the digital 
content. Embodiments of the invention are not limited to any particular type of 
annotation. In an example embodiment, the annotations are attributes of the user's 
response. Example attributes include a length of time spent browsing a given image, 
a number of times a given image is forwarded to others, or a galvanic response 
(excitement, nervousness, anxiety, etc.). Embodiments of the invention are not 
limited to meta-data annotations with to these attributes though. Any parameter of a 
user's response to digital content can be annotated in the meta-data 1 18. 

In one embodiment, the meta-data schema is a database record (tuple) that 
describes the attributes of the user's response (i.e. the kinds of parameters being 
measured). In a system with multiple users, the multiple user responses are kept as a 
list of individual responses in the meta-data 1 18 according to one embodiment of the 
invention. In an alternate embodiment, statistical summaries are generated from the 
multiple user responses. The statistical summaries are kept in the meta-data 118 
rather than the individual responses. An example of a statistical summary is a value 
for an average anxiety response. 

Referring back for Figure 2, the processing modules 1 10 comprise software 
and/or hardware modules that generate the meta-data 118 based on the viewer's 
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response. Generally, the processing modules 1 10 include routines, programs, 
objects, components, data structures, etc., that perform particular functions or 
implement particular abstract data types. 

Figure 4 is a more detailed block diagram of an example embodiment of a 
processing module such as the processing module 1 10 shown in Figure 2. As shown 
in Figure 4, the processing module 1 10 comprises a mechanism to identify a user 
120, a mechanism to observe a user's reaction to digital content 122, a mechanism 
to annotate observations 124, and a mechanism to consolidate the annotations 126. 

First, as shown in Figure 4, the mechanism to identify a user 120 determines 
who is actually consuming the digital content. In some embodiments, a receiver 
(shown in Figure 1 as element 104) is a multiple-user machine such as a television 
or a computer. In this case the user viewing the content is not always the same user. 
For example, different members of a family may watch the same television. In one 
embodiment, each member of the family is a different user. In an alternative 
embodiment the family is considered a group and the average reactions would then 
be recorded as group meta-data 118. 

Embodiments of the invention are not limited to any particular mechanism to 
identify a user 120. Some example mechanisms to identify a user 120 include, but 
are not limited to, biometric identification devices and electronic identification 
devices . Some examples of biometric identification devices include fingerprinting 
technology, voice recognition technology, iris or retinal pattern technology, face 
recognition technology (including computer vision technologies), key stroke rhythm 
technology, and other technologies to measure physical parameters. Some examples 
of electronic identification devices include radio frequency tags, badges, stickers or 
other identifiers that a user wears or carries to identify themselves. Other examples 
of electronic identification devices include devices that are remote from the user 
such as a smart floor or carpet that identifies a user. 

Second, as shown in Figure 4, the mechanism to observe a user's reaction to 
digital content 122 collects data about the user's response. In some embodiments, 
the mechanism to observe a user's reaction to digital content 122 is a system that 
observes emotional responses or a system that observes how people react to different 
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stimuli. In one embodiment, the mechanism to observe a user's reaction 122 senses 
states like boredom, anxiety, engagement, interest, happiness and other emotional 
states or moods. 

Embodiments of the invention are not limited to any particular mechanism to 
observer a user's reaction 122 to the digital content. Some example mechanisms to 
observe a user's reaction 122 include sensors that are in physical contact with the 
user and other examples include sensors that are not in physical contact with the 
user. Examples of sensors that are in physical contact with the user include sensors 
placed in items that the user handles or touches such as a computer mouse, a 
keyboard, a remote control, a chair, jewelry, accessories (such as watches, glasses, 
or gloves), clothing, and the like. Examples of sensors that are not in physical 
contact with the user include cameras, microphones, active range finders and other 
remote sensors. 

In some embodiments, the mechanism to observe a user's reaction to the 
digital content 122 collects data from the user passively. In alternate embodiments, 
the mechanism to observe a user's reaction to digital content 122 collects data from 
the user through active user input. In one embodiment, the mechanism to observe 
the user's reaction 122 includes functions for the user to expressly grade the digital 
content. In one example, a remote control includes buttons for a user to indicate 
their response to the digital content. 

In some embodiments, the data collected by the mechanism to observe a 
user's reaction to the digital content 122 includes data about physiological 
processes, data about viewing and/or browsing patterns, and data about verbal or 
nonverbal communication as previously described in detail by reference to Figure 2. 
In one embodiment, the mechanism to observe a user's reaction to digital content 
122 collects nonverbal communication data using computer vision technology for 
gaze tracking. In this embodiment, the data collected indicates whether or not the 
user is paying attention to the digital content being displayed. In another 
embodiment, the mechanism to observe a user's reaction to digital content 122 
collects data about the user's viewing and/or browsing patterns. Data about the 
user's viewing and/or browsing patterns is collected by monitoring keyboard and 
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mouse usage by the user. Data about the user's viewing and/or browsing patterns is 
also collected by monitoring usage of a remote control by the user. In one example, 
data from the usage of the remote control indicates if a user is fast-forwarding 
through a movie or if the user is pausing the movie at particular scenes. In another 
example, data from the usage of the remote control indicates if a user stops watching 
a movie before the movie is over. In still another example, data from the usage of 
the remote control indicates if the user is flipping between channels. In some 
embodiments, the data collected by the mechanism to observe a user's reaction to 
the digital content 122 includes data about physiological processes, data about 
viewing and/or browsing patterns, and data about verbal or nonverbal 
communication as previously described in detail by reference to Figure 2. 

Third, as shown in Figure 4, the mechanism to annotate meta-data 124 
annotates the meta-data with user-specific responses to the digital content. The 
user-specific meta-data is associated with digital content and includes annotations 
representing the user's reaction to the digital content. In one embodiment, the 
observations from one or more users are collected by a receiver (shown in Figure 1 
as element 104) and stored locally by the receiver (such as by a set top box, a client 
computer, a server computer, etc.) 

Embodiments of the invention are not limited to a particular mechanism to 
annotate meta-data 124. The observations may be stored using a standardized 
schema for meta-data. In one embodiment, the schema for the annotation is based 
on MPEG-21. The Moving Picture Experts Group (MPEG) began developing a 
standard for "Multimedia Framework" in June 2000. The standard called MPEG-21 
is one example of a file format designed to merge very different things in one object, 
so one can store interactive material in this format (audio, video, questions, answers, 
overlays, non-linear order, calculation from user inputs, etc.) MPEG-21 defines the 
technology needed to support "Users" to exchange, access, consume, trade and 
otherwise manipulate "Digital Items" in an efficient, transparent and interoperable 
way. In some embodiments, the digital content as described herein is a Digital Item 
as defined by MPEG-2 1 . 
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In one embodiment the mechanism to annotate meta-data 124 filters the 
input data received by the mechanism to observe a user's reaction 122. In this 
embodiment, the annotation representing the user's reaction is derived from the 
input data. In other words, the content of the annotation is not the input data. For 

5 example, if the input data is a sequence of keystrokes on a keyboard and the 

sequence of keystrokes are used to observe a user's reaction to the digital content, 
the annotation is not comprised of the sequence of keystrokes. Rather, the 
annotation comprises data derived by from the sequence of keystrokes. 

In another embodiment, the mechanism to annotate meta-data 124 identifies 

10 events from the input data. An event is an occurrence of significance identified 
using the input data. The event is derived from the input data and the event is 
annotated in the meta-data. For example, a speech is the digital content. If a 
crowd's response to a speech is being monitored, one event that is detected from the 
input data is a "loss of interest" event. A second event that is detected from the 

15 input data is an "interest" event. The "interest" event is identified, for example, by 
laughter or loud responses from the crowd. A third event that is detected from the 
input data is a "time of engagement" event. The "time of engagement" event is 
identified when the crowd really started paying attention to the speech. These three 
example events are annotated in the meta-data rather than the input data representing 

20 the crowd's response. The input data representing the crowd's response comprises, 
for example, motion data, facial expressions, gaze tracking, laughter, audio queues, 
and the like. Embodiments of the invention are not limited to any particular events. 
An event is any occurrence of significance that is that derived from the input data. 
The mechanism to annotate meta-data 124 annotates the event in the meta-data. 

25 In another embodiment, the mechanism to annotate meta-data 124 applies 

rules to input data received from multiple sources to identify events, user responses 
or user emotions. In an example embodiment, input data is received from multiple 
sources including: a microphone, surveillance of keystrokes, surveillance of mouse 
movement, and gaze tracking. In this example, the mouse movement alone is not 

30 enough to identify the user's response. However, if the mouse is moving fast, the 
keystroke speed is very high, the eyes are moving left and right, then it can be 
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inferred that the user's response is nervousness. The rules indicate that if A and B 
and C are present in the input data then a particular event or response has occurred. 

Fourth, as shown in Figure 4, a mechanism to consolidate the annotations 
126 consolidates the annotations stored by one or more receivers (104 in Figure 1) to 

5 one originator (102 in Figure 1). In other words, the mechanism to consolidate the 
annotations 126 collects the annotations in a single location. In one embodiment, 
the location is the originator (102 in Figure 1). In an alternate embodiment, the 
location is any location identified by the originator for consolidating the annotations. 
In one embodiment, an identifier for the originator of the digital content is recorded 

1 0 in the meta-data associated with the digital content. 

The mechanism to consolidate the meta-data 126 is not limited to operating 
on a particular type of network. In one embodiment, the mechanism to consolidate 
meta-data is a peer-to-peer communications mechanism. For example, a user 
forwarding pictures from a personal computer to recipients using different personal 

1 5 computers is a peer to peer network. In alternate embodiments, the mechanism to 
consolidate meta-data is a client-server communications mechanism. For example, 
if the receiver is a set-top box and the originator of the digital content is a cable 
service provider broadcasting a movie. The cable service provider is a server and 
the set-top is the client. 

20 In one embodiment, the mechanism to consolidate the meta-data 126 

opportunistically consolidates multiple local annotations from across a network to a 
single originator. In this embodiment, the consolidation is initiated when the 
network is idle. To determine when the network is idle, network traffic is monitored 
and/or CPU activity is monitored. Consolidating the meta-data when the network is 

25 idle reduces the impact on isochronous traffic on the network. In alternate 
embodiments, the consolidation occurs at any time. 

The consolidated meta-data can be used for a variety of purposes. According 
to an example embodiment, the consolidated meta-data provides an automatic 
ethnographic ranking system for the digital content. Other example uses for the 

30 consolidated meta-data are described in the example scenarios section below. 
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However, the consolidated meta-data is not limited to the particular uses described 
herein. 

Methods. Methods of example embodiments of the invention are described 

5 by reference to Figure 5 and 6. 

Figure 5 is a flow diagram of a method 500 according to an example 
embodiment of the invention. As shown in Figure 5, a user's reaction to digital 
content is received (block 502). Then meta-data based on the user's reaction is 
generated through computer automated operations (block 504). In alternate 

10 embodiments, the example method 500 shown in Figure 5 also comprises generating 
a ranking of one or more items of digital content based on the reaction of one or 
more users to the digital content. 

Figure 6 is a flow diagram of a method 600 according to another example 
embodiment of the invention. As shown in Figure 6, a user of digital content is 

1 5 identified (block 602). The user's reactions to the digital content are collected 
(block 604). Meta-data associated with the digital content based on the user's 
reactions is generated (block 606). Then, the meta-data is stored by a receiver 
(block 608). 

In further embodiments of the invention shown in Figure 6, meta-data from 
20 the receiver is transmitted to an originator or to a location identified by the 

originator. In an example embodiment, the identification of the user (block 602) is 
performed using an electronic identification device or a biometric identification 
device. The example methods performed by a system for annotating meta-data with 
user responses to digital content have been described; however, the inventive subject 
25 matter is not limited to the methods described by reference to Figure 5 and 6. 

Example Scenarios. Several example scenarios for annotating and/or using 
meta-data with user responses to digital content are now described. The scenarios 
provide examples for illustrative purposes only. 

The first example scenario is directed to watching a movie. The movie is 
30 distributed as digital content from an originator over the Internet, a cable network or 
a satellite network. A user watches the movie on a receiver of the digital content. In 
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this example, surveillance of the remote control, speech recognition, and active 
range finding are used to observe the user's reaction to the movie. If the user does 
not like the movie, the user may fast-forward through segments of the movie or the 
user may leave the room during the movie. If the movie is funny, the user may 

5 laugh or the user may say certain phrases. Thus, input data is collected by a system 
according to an embodiment of the present invention and used to annotate meta-data 
with the user's response to digital content such as a movie. 

The second example scenario is directed to watching a movie on a pay-per- 
view system. In this example, the responses of a many users are annotated in the 

10 meta-data. The originator is a commercial distributor of pay-per-view services. The 
receiver is a set-top box located in many individual's homes. The originator 
periodically consolidates the annotations stored by each set-top box and uses the 
annotations to adjust the price of the movie. The price charged for a movie depends 
on the viewer's opinions of the movie. When a new movie is distributed, the pay- 

1 5 per- view fee is a standard initial fee because no opinions are available for the movie. 
If a viewer is one of the first consumers to watch the movie, the viewer pays the 
standard initial fee. However, as viewers' opinions of the movie are collected using 
embodiments of the present invention, the originator adjusts the price of the movie 
in response to the viewers' opinions. If the viewers' like the movie, the originator 

20 will increase the cost of the movie based on the annotations of the user responses. 
Subsequent viewers will pay more to view the movie. If the viewers dislike the 
movie, the originator will decrease the cost of the movie based on the annotations of 
the user responses. In this instance, subsequent viewers will pay less to view the 
movie. Thus, embodiments of the invention enable flexible pricing of digital 

25 content in response to user responses on the piece of digital content. 

The third example scenario is directed to market research for future digital 
content. In this example scenario, the digital content is an movie or a speech. The 
granularity of the annotation is not limited to the entire movie or speech. The 
annotations may include user responses to particular portions of the movie or 

30 speech. In this example scenario, the originator performs market research and plans 
for future movies or speeches using the annotations. If during a particular scene of a 
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movie 30% of the users were so bored that they fast-forwarded to the end of the 
scene, the originator can look in retrospect at the annotations and see that this scene 
was unnecessary in the movie or just boring. So, the originator analyzes the 
annotations for a segment of digital content and uses the analysis to plan future 
5 movies or speeches. Thus, embodiments of the invention enable market research on 
digital content. 

The fourth example scenario is directed to analyzing audience reaction to 
verbal communications. Some examples of verbal communications include political 
or corporate speeches. In this example scenario, the annotations include responses 

10 of individuals or the audience as a whole to a speech that is broadcast to a television 
or Internet audience. Because the audience is not a live audience, the speaker does 
not get direct feedback on how the message is received by the audience and how the 
message may need to be revised. The annotated meta-data according to example 
embodiment of the invention provides a way for the speaker to receive feedback on 

1 5 the audience reaction to the speech. For example, if the annotations indicate that 80 
percent of the audience for a political speech laugh at something that the speaker 
intended to be serious, then the speaker knows there is a need to revise this portion 
of the speech before it is delivered again. Thus, embodiments of the invention 
provide feedback to speakers on the audience reaction even when the audience is not 

20 a live audience. 

Example Hardware and Operating Environment Figure 7 is a block 
diagram of an electronic system 700 for annotating meta-data with user responses to 
digital content in accordance with one embodiment of the invention. Electronic 
system 700 is merely one example of an electronic system in which embodiments of 

25 the present invention can be implemented. In this exampl e, electronic system 700 
comprises a data processing system that includes a system bus 702 to couple the 
various components of the system. System bus 702 provides communications links 
among the various components of the electronic system 700 and can be 
implemented as a single bus, as a combination of busses, or in any other suitable 

30 manner. 
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Processor 704 is coupled to system bus 702. Processor 704 can be of any 
type of processor. As used herein, "processor" means any type of computational 
circuit such as, but not limited to, a microprocessor, a microcontroller, a complex 
instruction set computing (CISC) microprocessor, a reduced instruction set 
5 computing (RISC) microprocessor, a very long instruction word (VLIW) 

microprocessor, a graphics processor, a digital signal processor (DSP), or any other 
type of processor or processing circuit. 

Electronic system 700 can also include a memory 710, which in turn can 
include one or more memory elements suitable to the particular application, such as 
1 0 a main memory 7 1 2 in the form of random access memory (RAM), one or more 

hard drives 714, and/or one or more drives that handle removable media 716 such as 
floppy diskettes, compact disks (CDs), digital video disk (DVD), and the like. 

Electronic system 700 can also include a keyboard and/or controller 720, 
which can include a mouse, trackball, game controller, voice-recognition device, or 
1 5 any other device that permits a system user to input information into and receive 
information from the electronic system 700. 

Electronic system 700 can also include devices for identifying a user of 
digital content 708 and devices for collecting data representing a user's response to 
digital content 709. 

20 In one embodiment, electronic system 700 is a computer system with 

periphal devices. However, embodiments of the invention are not limited to 
computer systems. In alternate embodiments, the electronic system 700 is a 
television, a hand held device, a smart appliance, a satellite radio, a gaming device, a 
digital camera, a client/server system, a set top box, a personal digital assistant, a 

25 cell phone or other wireless communication device, and so on. 

In some embodiments, the electronic system 700 enables continuous ranking 
of digital content over the content's complete life-cycle. In one embodiment, the 
digital content is received by the electronic system 700. Software or hardware in the 
electronic system 700 monitor users' reactions and browsing patterns. In one 

30 embodiment, these measurements are annotated locally in the electronic system 700 
and opportunistically consolidated globally throughout the peer-to-peer network. 
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These meta-data are collected automatically and become unique search keys to a 
community of consumers. These human-derived meta-data are particularly useful, 
for example, to enable efficient ranking and browsing of massive media collections. 
As a result, an example embodiment of electronic system 700 provides an automatic 
5 ethnographic ranking system for digital content. 

The present subject matter may be embodied in other specific forms without 
departing from the spirit or essential characteristics thereof. The present 
embodiments are therefore to be considered in all respects as illustrative and not 
restrictive, the scope of embodiments of the subject matter being indicated by the 

1 0 appended claims rather than by the foregoing description, and all changes which 
come within the meaning and range of equivalency of the claims are therefore 
intended to be embraced therein. 

It is emphasized that the Abstract is provided to comply with 37 C.F.R. 
§ 1.72(b) requiring an Abstract that will allow the reader to ascertain the nature and 

1 5 gist of the technical disclosure. It is submitted with the understanding that it will not 
be used to interpret or limit the scope or meaning of the claims. 

In the foregoing Detailed Description, various features are occasionally 
grouped together in a single embodiment for the purpose of streamlining the 
disclosure. This method of disclosure is not to be interpreted as reflecting an 

20 intention that the claimed embodiments of the subject matter require more features 
than are expressly recited in each claim. Rather, as the following claims reflect, 
inventive subject matter lies in less than all features of a single disclosed 
embodiment. Thus the following claims are hereby incorporated into the Detailed 
Description, with each claim standing on its own as a separate example 

25 embodiment. 
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